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(54) Managing Data Objects 

(57) A device for managing image and audio files 
displays thumbnails, which are representative of the 
files, on a screen in different arrangements, depending 
on the selected layout and order. When the user enters 



input to indicates that he or she. wishes; to : browse- 
through the thumbnails, the thumbnails move across the, 
screen in sequence, following a path through a focus 
outline in the center of the screen. The path followed by 
the thumbnails depends on the selected layout. - 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to managing da- 
ta objects. 

2. Related Art io 

[0002] Digital cameras, mini disks, and other devices 
for recording and playing digital media are becoming 
quite popular. These devices store digital media as data 
objects in memories such as flash memories, hard 1$ 
disks, and on-line storage. 

[0003] There are many methods available for manag- 
ing large numbers of data objects. For example, data 
objects are frequently managed using windows and 
folders. United States Patent 51917,488 describes a 20 
system for displaying and manipulating image.data sets. 
First, a window including programmed' groups is dis- 
played. When a user selects one of the programmed 
groups, then a second window is displayed with thumb- 
nails that represent data objects, of the selected pro- 25 
grammed group. 

[0004] Data objects are also handled in hierarchical 
lists, using static light-box metaphors. A light-box met- 
aphor displays images in the manner of "slides" all the 
same size on a white background. The "slides" are ar- 
ranged in a grid. 

[0005] There are methods known for selecting a for- 
mat for displaying data objects. For example, United 
States Patent No. 5,673,429 describes a system that 
displays a list of different display formats^ When the user 
selects a desired display format from the list, themtems 
that match the selected format are pulled from a data- 
base and displayed in a list that depends on the selected 
display format. 

[0006] Memory is becoming available in increasingly 
large capacities, which enable storage of increasingly 
large numbers of data objects. For example, memory 
cards are available that are capable of storing data for 
several hundred different digital photographs. However, 
conventional techniques, such as windows, folders, and 
lists, have a problem in that they are insufficient for pre- 
senting such large numbers of data objects in a manner 
that a user can easily and quickly understand. 

SUMMARY OF THE INVENTION 

[0007] Embodiments of the present invention seek to 
provide a method and device that allows a user to easily 
browse, view, manage, select, and command a large 
number of data objects. 

[0008] Embodiments of the present invention relate to 
an on-screen graphical user interface,* and database 
management. 
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[0009] According to one aspect of the present inven- . 
tion there is provided a device for managing data ob- 
jects, comprising displaying means, defining means, 
moving means, and enable/disable means. 
[0010] The displaying means is for displaying thumb- 
nails representative of data objects. The defining means 
is for defining a focus region that indicates a focus 
thumbnail subject to processes. The moving means is 
for moving the displayed thumbnails along a predeter- 
mined path through the focus region. 
[001 1 ] The enable/disable means is for selectively eri- . 
abling and disabling the moving means. When the ena- 
ble/disable means disables the moving means, then the 
displaying means statically displays a singje thumbnail 
in the focus region.' When the enable/disable means en- 
ables the moving means, then the displaying means dis- 
plays the thumbnails to move along the predetermined 
path through the focus region. 

[001 2] Further particular and preferred aspects. of the 
present invention are. set-out in the accompanying inde- 
pendent and dependent claims. Features of the depends 
ent claims may be combined with features of the inde- 
pendent claims as appropriate, and in combinations oth- . 
er than those explicitly set out in the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] The present invention will be described further, 
by way of example only, with reference to preferred em- 
bodiments thereof as illustrated in the accornpanying 
drawings, in which: 

Fig. 1 is a schematic view showing a window display 
with thumbnails arranged in a line layout; 
Fig. 2 is a schematic view showing the window dis- 
play with thumbnails arranged in a circle layout; 
Fig. 3 is a schematic view showing the windowdisr 
play with thumbnails arranged in a grid layout; 
Fig. 4 is a schematic view showing the window dis- 
play with thumbnails arranged in a helix layout; 
Fig. 5 is a block diagram showing components of a 
computer and peripheral equipment for displaying 
the window display of Figs. 1 to 4; 
Fig. 6 is a block diagram showing functional mod- 
ules the computer of Fig. 5; 

Fig. 7 is a flowchart representing overall processes 
for implementing the functional modules of Fig. 6; 
Fig. 8 is a flowchart representing processes for 
changing layout or order of thumbnails in the win- 
dow display; 

Fig. 9 is a flowchart representing processes for tak- 
ing a closer look at a focus thumbnail; 
Fig. 10 is a flowchart representing processes for 
performing further process on the focus thumbnail; 
Fig. 1 1 is a schematic view showing movement of 
a thumbnail representing a first-loaded data object; 
Fig. 12 is a schematic view showing movement of 
thumbnails as further data objects are loaded; 



EP1 148 412 A2 



35 



40 



45 



SO 



2 



3 



EP 1 148 412 A2 



4 



Fig. 13 is a schematic view showing movement of 
thumbnails as further data objects are loaded; 
Fig. 14 is a schematic view showing movement of 
thumbnails as further data objects are loaded; 
Fig. 1 5 is a schematic view graphically representing 5 
pivoting movement of a thumbnail line in the line lay- 
out; 

Fig. 1 6 is a schematic view showing browsing mo- 
v tion of a thumbnail grid in the grid layout; 
Fig. 1 7 is a schematic view showing browsing mo- . io 
tion of a thumbnail helix in the helix layout; 
Fig. 18 is a schematic view showing motion of a 
thumbnail when a new order is selected; 
Fig. 1 9 is a schematic view showing the display win^ 
dow when a closer look is taken at the focus thumb-; *5 
nail; 

: Fig. 20 is a graphical view for explaining the pivoting 
movement of the thumbnail line; 
* Fig. 21 is a graphical view for explaining the form of 
? the circle layout; eo 
Fig. 22 is a graphical view for explaining the form of 
the helix layout- 
Fig. 23 (a) is a schematic view showing displayed, 
position of thumbnails before, during, and after the- 
focus thumbnail is changed; 25 
Fig. 23 (b) is a schematic view:showing timing of 
change of the focus thumbnail; 
Fig. 24 is a flowchart showing operations for imple- 
menting movement of the thumbnails shown in Fig; 
23(b); 30 
; Fig; 25 is a view schematically showing determina- 
" tion of a new position for the newly selected thumbs 
• nail; 

Fig. 26 is a schematic view representing processes 
for displaying audio files visually as thumbnails; . 35 
Fig; 27 is a schematic view showing thumbnails di- 
vided into sections depending oathe amount of da- 
. ta in corresponding audio files; - 

Fig. 28 is a schematic view showing configuration 
of a CD-ROM; 

- - Fig; 29 is a schematic view showing configuration 

of a memory card; 
a Fig. 30 is a schematic view showing thumbnails dis- 

- played according to the size, of the corresponding 
data files; - 45 . 
Fig. 31 is a schematic view showing thumbnails dis- 
played separated from each other depending on 
timing of the corresponding data files; and . 
Fig. 32 is a schematic view showing thumbnails dis- 
played in groups depending on the relationship of so 

. thecorrespbnding data files. 

DETAILED DESCRIPTION OF THE EMBODIMENT 

[001 4] Next, a system according to an embodiment of 55 
the present invention will be described while referring to 
the accompanying drawings. The system is for manag- 
ing data objects such as digital image files, digital audio 



files, text files, executable programs, program files, and 
movie files. 

[0015] As shown in Figs. 1 to 4, the system displays 
a window 20 including a thumbnail screen 21 and a lay- 
out/order interface 22. Thumbnails 23, that represent a 
variety of data objects, are displayed in the screen 21 . 
As shown in Figs. 1 and 3, each of the thumbnails 23 
includes an image that is the essence of the correspond- 
ing data object. The thumbnails shown in all other draw- 
ings include similar images, but the images have been 
omitted from the drawings to facilitate explanation. 
[0016] The thumbnails 23 can be displayed in any of 
four different graphical display layouts: a line layout as 
shown in Fig. 1 , a circle layout as shown in Fig. 2, a grid 
layout as shown in Fig. 3, and a helix layout as shown 
in Fig. 4. As will be described in detail below, the layouts 
use the X and Y dimensions and scale to layout thumb- 
nails that represent various data objects. \ 
[0017] As shown in. Fig. 1, a focus outline 24 sur-. 
rounds the center-most, or focus, thumbnail 25 in the. 
thumbnail screen 21 . The focus outline 24 indicates that 
the focus thumbnail 25 is currently the focus of any op- 
erations initiated by input from, the user. For example, 
when input is received for browsing through the thumb 1 
nails 23, the thumbnails 23 are dynamically scrolled 
across the screen through the focus outline 24, following t 
a path. P according to the presently implemented layout 
as indicated by arrows P in Figs. 1 , 2, 16, and 17. In this 
way, the user's attention can be selectively drawn to par- 
ticular ones of the thumbnails 23 by dynamically moving 
the thumbnails 23 through the single screen 21, rather 
than by using multiple windows in the conventional ma% 
ner. The sirigle screen 21 is advantageous over multiple 
windows, because the single screen 21 gives the user 
a primary focus and a single unifiecteontext as he or she 
manipulates the thumbnails 23, which represent data 
objects. As will be described in detail below, thethumb : 
nails 23 are moved by panning, scrolling, and zooming 
in the screen 21 to change the degrees of focus placed 
on the thumbnails 23. : 

[0018] An information tab 26 is displayed within the 
focus outline 24 at a position below the focus thumbnail 
25. The information tab. 26 includes further information 
about the focus thumbnail 25 such as a file name, date, 
size, and file type of the data object that corresponds to 
the focus thumbnail 25. 

[0019] The layout/order interface 22 is displayed at 
the bottom of the screen 21 below the display of the 
thumbnails 23, and includes a layout interface 27. and 
an order interface 28. The layout interface 27 includes 
icons 27a to 27b representing each of the four different 
layouts. The user can select a desired display layout by 
selecting the corresponding. icon 27a to 27d, using a 
mouse and cursor for example. The icon 27a to 27d that 
represents the presently selected layout is displayed 
near the center of the layout/order interface 22 to indi- 
cate the presently selected layout. The selected icon 
can also be changed by clicking on the center icon, or 
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by clicking on an icon 27e. With each click, the icons 
27a to 27d switch places with the selected icon one after 
another in order. The graphical icons 27a to 27d allows 
a user to select a display layout with more confidence . 
that when selecting by using a list. .. . 5 
[0020] The order interface 28 is for selecting one of 
four different sequence orders that determined arrange- 
ment of the thumbnails 23 in the selected layout. The 
four orders include: name of data object, type of data 
object, size of the data file, and time the file was stored. 10 
The order interface 28 is displayed at the right bottom 
of the screen, and includes words 28a to 28d that rep- 
resent each of the four different order types. The word, 
name 28a in this example, that represents the selected 
order is displayed near the center of the layout/order in- *5 
terface 22. The selected icon can be changed by either 
clicking on a desired word, or by clicking on an Icon 28e. 
[0021] Here, a more detailed description of the four 
layouts will be provided. As shown in Fig, 1 iin the line 
layout, the thumbnails 23 are aligned in a slightly over- so 
lapping manner in a single continuous angled line: File 
names 31 for the data objects, are displayed in a sepa- 
rate angled line that intersects the angled thumbnail line. 
The line Mayo ut has a clear-beginning and end, so the 
user can easily grasp the number of data objects. .'. . 25 
[0022] As shown in Figs. 2 and 16, the: circle layout 
consists of slightly overlapping thumbnails 23 in an arc. 
of a circular ring. Filenames 31 corresponding to. the. 
thumbnails 23 appear in an arc of a second ring that is 
symmetric to, but inverse from the thumbnail arc. Al- 30 
though not shown in the drawings, when there are only 
a few thumbnails in the circle layout,) the entire circular 
ring of thumbnails is displayed in the screen 21 . At this 
time, filenames are displayed in a circle below the 
thumbnail circle. However, the ring enlarges as the ^ 
number of thumbnails increases, until a portion of the 
thumbnail ring can not be displayed; When the ring con- 
tains thumbnails up to a certain number, then the radius, 
of the arc increases as the size of the ring increases. 
However, once a certain number of thumbnails 23 is ex- 40 
ceeded, so that the ring reaches a certain size, then only 
an arc having a predetermined radius is displayed as 
shown in Fig. 2. The radius of the arc is fixed regardless 
of how many thumbnails 23 are in the ring, because if 
the radius were varied according to the number of 
thumbnails 23 in the ring, then the displayed arc would 
appear linear when the ring contains a large number of 
thumbnails 23. . 
[0023] As shown in Fig. 4, in the grid layout, the 
thumbnails 23 are aligned vertically and horizontally,' so 
that is, with fixed mutual position in.horizontally-extend 1 
ing rows and vertically-extending columns. The number 
of thumbnails in the rows of the grid layout is determined 
by how many thumbnails 23 if aligned side by side; can 
be displayed completely on the screen. In the example 55 
shown in Fig. 4, five thumbnails 23 are disposed side by 
side in each horizontal row, because in this example 
complete rows of five thumbnails 23 can be displayed 



in the screen 21. without the thumbnails in the rows over- 
lapping. Any further thumbnails are added by increasing 
the number of rows, that is, by adding the thumbnails to 
elongate the columns. It should be noted that rows with 
more or less than five thumbnails might be desirable, 
depending on the displaying conditions; The thumbnails 
23 contact each other on lateral sides, but have a space 
between top and bottom sides. The file names 31 ap- 
pear below each corresponding thumbnail 23. The grid 
layout displays more complete rows of thumbnails 23, 
without the thumbnails overlapping, than any of the oth- 
er layouts. 

[0024] As shown in Fig; 4 : the thumbnails 23 in the. 
helix layout are displayed in the screen 21 in different 
scales to give the illusion of viewing a three-dimensional 
helix from the side. That is, thumbnails 23a at the far 
side, of the helix are displayed in a smaller scale than 
thumbnails 23b at the near side of the helix. The helix 
shape includes rings 35a.to 35c of thumbnails 23. Each 
ring 35a, 35b, 35c includes about ten thumbnails 23. 
The helix layout shows a large number of thumbnails at 
the same time, while maintaining the benefits of a line 
configuration. 

[0025] Next, configuration of the file management 
system for displaying the window 20 will be explained, 
along with further explanation of various features of the 
file management system. As shown in Fig. 1, the file 
management system includes a computer 1 , a memory 
card 2, a display 3, and a user input unit 4; 
[0026] The memory card 2 can be any memory card, 
such as a Memory Stick™, a SmartMedia™! memory 
card, or a Compact Flash™ memory card. The memory 
card 2 stores data files for a large number of photo- . 
graphs, songs, or any other type of cata objects. The 
other modules of the system can write data objects into, 
or read data objects from, the memory card 2. The user 
input unit 4 can be any user interface for inputting com- 
mands and the like, such as a keyboard, a jogrdial, a 
. game controller, or an on-screen unit such as a mouse 
or a pen. 

[0027] The computer 1 includes a slot 2a for insertion 
of the memory card 2, a memory card interface 10, a 
CPU 11, a ROM 12r.a RAM 13, a hard disk 14, a : user 
interface 15, a display interface 16, and a network inter- 
face 17, all connected together by a bus 16. The user 
•i Interface 15 is connected to the user input unit 4. The 
display interface 16is connected to the display 3. The 
network interface 1 7 is connected to a network 5. 
[0028] Fig. 2 shows functional modules of the compu- 
ter 1 As shown the computer 1 includes a file manager 
11 , a layout/order manager 12; a search manager 13, a 
program manager 14, and a layout/order template stock 
15. The functional modules are realized by. application 
software stored in the hard disk 14, or retrieved over the 
network 5. 

[0029] The file manager 11 reads data objects from 
the memory card 2 and stores them in memory, such as 
the RAM 13. 
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[0030] The layout/order template stock 1 5 is memory, 
such as the hard disk 14, that holds a layout/out tem- 
plate for each combination of the four layouts and the 
four orders. Each layout/order template contains two pri- 
mary rule sets for the corresponding layout, one set of 
rules for setting relative positions of thumbnails 23 and 
another set of rules for movement of thumbnails 23. 
[0031] Although rules in the layout/order templates 
will be described iater^ with respect to relative position 
of thumbnails, a layout/order template for the grid layout 
includes layout rules that indicate that each thumbnail 
should be positioned immediately to the right of the pre- 
ceding thumbnail, unless the thumbnail is sixth in a 
thumbnail sequence. If the thumbnail is sixth in the se^ 
quence, then the thumbnail should be positioned under- 
neath the first image in the sequence in order to begin 
a new sequence, that is, to start a new row in the grid. 
The templates for the line, circle, and helix layouts in d^ 
cate that the thumbnails should be aligned in line, circle, 
and helix patterns, respectively. 

[0032]' With respect to rule for movement of the 
thumbnails; the grid template also includes rules defin- 
ing that the thumbnails in the grid layout move as shown 
in Fig. 16 when the user browses through the thumbnails 
in a manner to be described below. The templates for 
the line, circle, and helix layouts indicate that the thumb- 
nails should be move following linear, circular, and spi- 
ral ing paths, respectively. ■ 

[0033] The program manager 14 reads a layout/order 
template from the layout/order template stock 15 for the 
presently selected layout and order. The program man- 
ager 14 writes the template into the file manager 11 to 
apply the ternplate to therdata objects stored by the file 
manager 1 1 . The program manager 1 4 reads templates 
from the layout/order template stock 15 and writes them 
in the file manager 11 each time the layout or order is 
changed, because only one set of display rules needs 
to be in active memory at any one time. 1 
[0034] The layout/order manager 12 reads informa- 
tion about the data objects in the file manager 11 , and 
draws the corresponding thumbnails 23 accordingly in 
the presently selected layout. The file. layout/order man- 
ager 12 controls the display 2 to display the thumbnails 
accordingly. ^ ~ 
[0035] The search engine 1 3 enables a user to search 
for data-objects based on inputted search criteria. The 
search engine 13 incrementally writes the criteria in the 
file manager 11; The display 3 changes the screen 21 
to display only thumbnails of data objects that satisfy the 
search' criteria. The search engine 13 supports key 
words and file attributes, such as date, size, color. 
[0036] Here, operations of the computer 1 will be de- 
scribed while referring to the flowcharts in Figs. 7 to 10. 
In S1 , the operating system of the computer 1 recogniz-. 
es the memory card 2 when the memory card 2 is in- 
serted into the slot 2a. As a result, the operating system 
launches an executable application for performing the 
functions of the file manager 11 , the layout/order man- 



ager 1 2, and the other function modules in Fig. 6. The 
executable application can be either retrieved for this 
purpose from where it is stored in the hard disk 14; or 
downloaded from over the network 5, for example. In 
5 S2, the file manager 1 1 judges whether the memory card 
2 stores any data objects; If not (S2: NO), then the ap-. 
plication is ended here. 

[0037] On the other hand, if the merhory card 2 stores 
data objects (S2:YES), then in S3 the file manager 11 

10 loads the data objects from the memory card 2 one at a 
time into the RAM 13. In S4, the program manager 14 
determines the presently selected layout and order for 
display of thumbnails to represent the data objects. In 
the present example, the line layout is set as the default 
layout, and file name is set as the default order. The pro- 
gram manager 14 then pulls the appropriate layout/or- 
der template from the layout/order template stock 15- 
and stores the layout/order template in the RAM 12. The 
program manager 14 -writes the template on the file 

20 manager 11 , thereby applying the template to each data 
object in the file manager 11 . 

[0038] In S5, the file layout/order manager 12 draws 
a data view for the thumbnails 23 according to the pres- 
ently selected layout and order,' and controls the display . 

25 2 to display the thumbnails accordingly. 

[0039] Each thumbnail 23 is displayed as soon as re^ 
trieved by the file manager- 11, and during the loading 
process the thumbnails are dynamically arranged on the 
screen according to -the presently selected layqut/That 

so is, as shown in Fig. 1 1 . a thumbnail ; 23c of the first- load- 
ed data object is displayed atthe upper left comer of the 
screen 21 and then moved to the center^of the screen 
21 ; The focus outline 24 is displayed surrounding: the 
thumbnail 23c in a size that matches the dimensions of 

35 the thumbnail 23c; 

[0040] As shown in Fig. 12, a thumbnail 23d of the 
second-loaded data object is similarly displayed/at the 
upper left comer and then . moved. to the! center of the 
screen 21. At this time, the first thumbnail 23c moves 

to slightly to the lower left of center. Once the thumbnail 
23d is centered in the screen 21, Jt is displayed, sur- 
rounded by the focus outline 24 to indicate that the 
thumbnail 23 d is the currently selected thumbnail. In this 
way, the center thumbnail is always designated as the 

45 - focus of user input. As shown in Figs, 13 and*14 t this 
process continues until all the data objects have been 
loaded from the memory card 2 into the file manager 1 1 . 
The user need not wait for. all data objects to be loaded; 
but can begin browsing through the thumbnails while the 

50 remaining data objects are. being loaded. 

[0041] During and after the loading process* the lay- 
out/order manager 1 2 controls the display 3 to move the 
thumbnails in the line layout dynamically with a recipro- 
cal pivoting motion, based on the oscillation of a pendu- 

55 turn. The center of the focus thumbnail 25 serves as the 
unmoving axis of the pivoting movement In Fig. 15, the 
positions of thumbnails while at one extreme of the piv- 
oting motion are indicated in solid line arid the positions 
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of thumbnails while at the other extreme are indicated 
in dotted line. The reciprocal pivoting motion exposes 
most or all of. each thumbnail over a short period of time, 
so that the viewer can gain a better grasp of each dis- 
played thumbnail. For example, as the thumbnail line 
swings back and forth, lower right and left sections 23f, 
23f" of a thumbnail 23f are alternately exposed. It should 
be noted that all the other layouts except the grid layout 
also move: dynamically to reveal most or all of each 
thumbnail in time. 

[0042] This movement of the thumbnail layout also in- 
forms the user that the thumbnail can be interacted with 
in a dynamic manner. For example, the user can choose 
to change the layout or order of the thumbnails (S6), to 
look closer at the data object that is presently selected 
(S7), or to browse through the thumbnails (38). 
[0043] If the user wishes to browse through the 
thumbnails (S8:YES), then in S9 the program manager 
14 receives -browsing input from the user. In S10, the 
layout/order manager 1 2 controls the display 3 to adjust 
how the thumbnails 23 are displayed, according to- the . 
browsing .input. from the user. In S11, the layout/order 
manager 12 continuously adjusts display screen of the 
display 3 as long as input is received from the user. Once 
the user stops providing browsing input (S11:NO), then 
the • routine returns to S6: 

[0044] When the browsing input is singular in nature, 
such as from pressing an arrow key ona keyboard once, 
then this indieatesthat the user wishes to change the 
selected thumbnail 25 to the thumbnail adjacent to the 
current selected thumbnail, that is, the thumbnail either 
prior or subsequent to the center thumbnail in the dis- 
played: thumbnail train; As a result, the layout/order 
manager 12 controls the display 3 to smoothly shift the 
thumbnail in the thumbnail train one position in the di- 
rection that moves the indicated adjacent thumbnail to 
the center of the screen- Although the focus outline 24 
remains generally at the center of.the screen. 21; it can 
also be moved slightly toward the . adjacent thumbnail as, 
the adjacent thumbnail is shifted toward center, to furr 
ther increase the smooth flowing movement of the dis- 
played layout; v 

[0045] When the : browsing input is continuous in na- 
ture; such as when the user continuously holds down, 
an arrow key, then the layout/order manager 1 2 controls 
the display 3 to continuously stream the thumbnails train 
through the focus outline 24 on the screen-21 . This en^ 
ables the user to browse through the thumbnails of all 
the loaded data objects, even when the memory card 2 
stores a great number of data objects, so that not all 
thumbnails can be displayed on -the display 3 at the 
same time. . • 

[0046] In the case of the circle layout,. the displayed 
circle of thumbnails rotates so that the thumbnails 23 in 
the loop move through the focus outline 24. This allows 
the user to browse in a circular manner. The user does 
not have to be conscious of the beginning or end be- 
cause they are linked. As mentioned above, when the 



ring can include a large number of thumbnail, then only 
a portion of the thumbnails are displayed at one time in 
an arc as shown in Fig. 2. In this case, the displayed 
thumbnails 23 are sequentially moved on and off the dis- . 
play during the browsing operation, thereby constantly, 
changing the thumbnails presently being displayed: . 
[0047} jn the case of the grid layout, all the thumbnails 
23 remain in the same position with respect to each oth- 
er during the browsing operation. When the user input 
indicates horizontal scroll, then as shown in Fig.. 16 the 
entire grid is . moved in a zigzag pattern across the 
screen 21 as indicated by arrow. P. Although the grid is. 
actually configured with the same or smaller.width than 
the screen 21 , the width of the grid is shown larger than 
the width of the screen 21 in Fig. 21 to facilitate under- 
standing; This- moves the thumbnails 23 of separate 
rows through the focus outline 24 in a flowing motion. 
Rows are followed one after the other in succession 
starting from the same end of each successive row. As 
with the line layout, the focus outline 24 moves slightly 
to meet the next thumbnail in the train. When the user , 
input indicates horizontal scroll; the thumbnails 23 in the 
column that includes the focus thumbnail 25 are moved , 
through the focus outline 24 one at a timei Because the = 
horizontal dimension of the grid is , set to a number 
thumbnails thatcan be displayed all -at one time, .thatis.,- 
to five thumbnails in the present embodiment; browsing 
is simpler for the user, because he needs to think basi- 
cally in a. single dimension, rather than in two dimen;-- 
sions as would be the case if the grid were made large r 
in the horizontal direction. As a result, the user. browses 
mainly hrthe vertical direction during the grid layout: ^ 
[0048] In. the case of the helix layout, when the user 
input indicates horizontal scroll, the helix spirals verti- 
cally in order to move the thumbnails 23 through the fo-. 
cus outline 24. The amount that the helix screwingiy ro- 
tates-depends on the number of thumbnails, 23 scrolled.; 
When more than a few thumbnails are scrolled in. sue-, 
cession, then as shown in Fig. 17 the rotating helixis 
displayed in a contracted shape- by reducing the radius 
of the, helix and the inter-thumbnail distance, while the 
thumbnails 23, flow through the focus outline 24. When 
the continuousbrowsing input continues for longer than 
a certain duration of time, then the speed at which the 
thumbnails 23 move is accelerated. At this time, the disr. 
play of the thumbnails 23 is adjusted to match the brows- 
ing speed. For example, the helix of the helix layout is 
displayed to contract- with increase in browsing speed 
and expand with decrease in browsing speed. This vis-., 
ual change increases the user's awareness that the 
browsing speed has changed. The display of the. circle 
layout is similarly contracted and expanded based on 
the duration and speed of browsing. 
[0049] Returning to Fig. 4, when the user input indi- 
cates vertical scroll through the helix, the entire helix is 
shifted vertically by one pitch D, that is, by one inter-ring . 
distance, without rotating. As a result, the present focus 
thumbnail 25 is shifted out of the focus outline 24, and 
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the largest-scale thumbnail of the upper or lower adja- 
cent ring, depending on the direction of scroll, is shifted 
into the focus outline 24. In the example shown in Fig. 
4, when the user input is for moving the vertically by a 
single thumbnail, the helix is shifted downward by one 
pitch D so that the thumbnail 25' of the ring 35b shifts 
out of the focus outline 24 and the thumbnail 25" of ring 
35a shifts into the focus outline 24. Because jumping to 
an adjacent ring in this way skips over the interposing 
ten thumbnails, the user can browse through more 
thumbnails much more rapidly than in the other layouts. 
Furthermore', with each jump, the ten thumbnails of an- 
other ring are brought into the range of the screen 21 . 
[0050] When the user wishes to change the layout or 
order of the thumbnails (S6:YES), then the routine pro- 
ceeds to S20 of the flowchart of Fig. 8. In S20, the layout 
or order selected by the user is determined. In S21 , the 
program manager 14 determines the rules for the newly N 
selected layout or order, and pulls but the appropriate 
template, from the layout/order template stock 15. In 
S22, the program manager 14 applies the template to 
the data objects in the file manager 11 . In S23, the lay- 
out/order manager 12 creates a new display view, and 
controls the dfeplay 3 accordingly. 
[0051] NAm'en the processes in S21 to S22 are per- 
formed to implement a new layout, the icon that repre- 
sents the selected layout is shifted rightward to near the 
center bottom of the screen to indicate its selected con- 
dition. The icon of the preceding selected layout shifts 
leftward to trie side to join the icons of the other non- 
selected layouts. This enables a user to easily know 
when he properly selected a layout icon. At the same 
time* the thumbnails 23 are repositioned from the pre- 
ceding layout into the newly selected one. 
[0052] For example, while the thumbnails, 23 are be- 
ing display ed' in the line layout as shown in Fig 1, when 
the. user input indicates selection of the circle layout, the 
line layout icon 27d and the circle layout icon 27a move 
leftward and rightward respectively to switch positions, 
and the thumbnails 23 move into the circle layout, re- 
sulting in the display shown in Fig. 2. The actual move- 
ment of the icons is displayed. Also, actual movement 
is shown of the thumbnails from positions of the line lay- 
out into positions of the newly selected circle layout. This 
enables the user to know that the newly selected layout 
was properly implemented. 

[0053] When the processes in S21 to S22 are per- 
formed to implement a new order, then in a manner sim- 
ilar to implementation of a new layout, the word that rep- 
resents the newly selected order is shifted leftward to 
near the center bottom of the screen to indicate its se- 
lected condition. The word of the preceding selected or- 
der shifts rightward to the side to join the words of the 
other non-selected orders. At the same time, the thumbs 
nails 23 are repositioned from the sequence of the pre- 
ceding order into the sequence of the^newly selected 
order. 

[0054] In the example shown in Fig. 18, the user se- 



lects the type word 28b while the thumbnails 23 are be- 
ing displayed in name order. In the shown example, all 
of the thumbnails 23 are the same type except for a 
thumbnail 23g, which represents a music file instead of 

5 an image file like the rest of the thumbnails 23. When 
type is selected for the order, then the thumbnail 23g 
falls out of line and shifts to the lead position of the line. 
The previous lead thumbnail 23h and other intervening 
thumbnails 23i all shift back one inter-thumbnail dis 1 

10 tance to restore order to the line. Actual movement of 
the thumbnails is shown from' positions of the preceding 
order Into positions of the newly selected order to enable 
the user to know for certain that the change in order was 
successful. 

15 [0055] A user can get a closer look at a desired thumb- 
nail by increasing the scale of the thumbnail in the focus 
outline 24 to a larger scale. When the user wishes;tb 
look closer at the data object that is presently selected. 
(S7:YES), then the routine proceeds to S30 of the flow- 
20 chart of Fig. 9. In S30, input is received from the return . 
key of the keyboard or equivalent input unit to indicate 
that the focus thuriibnail 25 is selected. Then -as a result 
of S31 to 33, the screen appears as shown in Fig. 19/ 
That is, in S31 the layout manager 12 increases the 
25 scale of the focus thumbnail 25 ; in the focus outline 24 
to a larger scale. In S32- the program manager 14 dis- 
ables the layout and order interfaces 27, 28 at the bot- 
tom of the screen 21 , and in S33 enables a command 
interface 40 including icons 40ato 4uc,* which represent 
30 various application launchers.- Arrows 40d are also dis;- 
played f or indicating the icon > of the application that will 
be launched when a command is received from the users 
The user can change location of the arrows;40d by per- 
forming horizontal scroll operations. If the focus thumb- 
35 nai! 25 represents an audio file; then the program man- 
ager 14 plays the audio file when the focus thumbnail 
25 is selected. If the focus thumbnail 25 represents a 
movie file, then the program manager 14 plays the mov- 
ie when the focus thumbnail 25 is selected. 
40 ' [0056] Next in S34, the user has the opportunfty to 
use the command interface 40 to perform a variety of 
different processes oh the selected data object. If the 
user does not wish to process the selected data object 
(S34:NO), then in S35 user, input to this effect is re- 
ceived, such as from the user again pressing the return 
key while the arrows 40d surround all of the icons 40a 
to 40c, which indicates that no particular application has 
been selected. In S36, the layout/order manager 12 re- 
duces the thumbnail 25 back to the original small scale. 
50 Then the flow returns to S6 or S30. 

[0057] On the other hand, if the user wishes to proc- 
ess the selected data object (S34:YES), then the flow 
proceeds to S40 shown in the flowchart of Fig. 10. In 
S40 t the user selects what process he wishes to perform 
55 on the selected data object. For example, the user can 
select to launch an application relating to the selected 
• data object, to edit the data object using an edit inter- 
face, or to bookmark the data object using a bookmark 
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interface. When the user chooses to launch an applica- 
tion, then in S41 the userselects the desired application. 
In S42, the program manager 14 accesses the operating 
system and launches the selected application. In. S43, 
the file manager 11 transfers the selected data object to 5 
the launched application; In S44, the layout/order man- 
ager 12 reduces size of the focus thumbnail. 25 to the . 
original scale. In S45, the program manager 14- moves 
the launched application to. the front. If the launched ap- 
plication is the one, the user desired (S46:YES), thein 10 
S47 the user uses the new application and this flow is 
ended. If not (S46:NO), then the flow returns to point S6. 
[0058] When the application is. closed, before com-., 
pletely stopping display of the thumbnails, the thumb- 
nails are shown scattering off the screen, to stress that is 
the application has been terminated. - 
[0059] . He re. : . the layout/order templates for determin- 
ing mutual position and movement ol thumbnails in each 
layout .will be described in more detail. The layout man- . 
ager 1 4 also includes information for defining the focus 20 
outline. 24:at a position at or near the center of the screen 
21 . In;templates for all: layouts, the Jnter-thumbnail dis- 
tance is setto a constant value of 64 pixels on the screen 
21- •.; - .■ " ' - ■ 

[0060]; With respect tO:the line, layout, the thumbnails . 25 
are aligned on a line separated by 64 pixels. The line 
extends to. a length L,. which equals the number n of. 
thumbnails tirneSv the constant 64 pixels (L=64n). 
[0061]. . The content of the; layout/order template for 
producing, the reciprocal pivoting motion of the thumb-. 30 
nail fine will be described, with reference to Fig. 20: It 
should be noted than the pivoting movement of the line 
layout continues even during: browsing. The center of 
thumbnails and the center of filenames are aligned.on 
different ones of lines 1 and 2; separated from each oth- 35 
erby the distance 64 pixels.The Jines/I. and 2 are shown , 
in .Fig. -20: at- the extremes of the reciprocal pivoting 
movement. Movement of the lines: 1 and 2 are defined 
using the following formulas: 

; Line fy = sin(g t) (y- c 0 ) + Cl 

_ . I^e 2 y =.- sin(|t^ 

wherein x and y are coordinates on the display screen 
21;.- 

t is time in seconds; and 

c 0 and c 1 are the coordinates at the center of the 
screen 21. 

[0062] Inthe example of Fig. 20, c 0 represents the dis- 
tance from the top of screen 21 to the center, of the 
screen, and c 1 represents the distance from the right 
side of the screen 21 to the center.of the screen. Angle 55 
6 shown in Fig. 20 is determined using the following for- 
mula: . * 




[0063] The template for the circle layout will be ex- 
plained with reference to Fig. 21. The radius r of the 
thumbnail and file name circles is determined based on 
the following formula: 

64n . . . 
r 2jc 

[0064] The center of the thumbnail circle is deter- 
mined based on the following formula: 

( x ctrde1 ■ Y circle 1 ) = ( X cent» Y cenf f -64 ) 



[0065] . The center of -filename circle is determined, 
based on the following formula: 

( x cbcte2. Y cirde2) = < x cent' Y cent +r+64 )' 

[0066] The position of each thumbnail in 4he. thumb- 
nail circle is.determined based on the following formula:v ; 

(Xlii Vli) = ( X circ»e1 + rsin ^ 0. ydrcler + r ^ S 0) 

[0067] The position: of each file name in the file name . 
circle is determined based on the following formula: . ; 

2tc 2it * 

( X 21 • Y2i) = ( x cbde2 + r s jn (— 0, ycirctea ; r cos (— i))^ 

[0068] Here, the template for displaying. the, helix layr 
out will be explained with reference to Fig. 22. The x, y, \ 
^ and z coordinates of each thumbnail in the. helix are de- ^ 
termined based on the following formulas: 

2*71 r 

z 1 = r-rcos j) * V 

wherein i is a thumbnail number representing. a 
target thumbnail of all the thumbnails. For example, to 
determine the position of a second thumbnail in the 
thumbnail train,: the value of i is set to two. The value of. 
j is determined by subtracting n from i (j=i-n), wherein n 
is the thumbnail number of the focus thumbnail. For ex- 
ample, if the target thumbnail is the focus thumbnail, 
then j would equal zero. The scale of each thumbnail 23 
is determined based on its Z-axis coordinate. ; 
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[0069] Next, content of the templates for determining 
slide movement during browsing will be explained while 
referring to Figs. 23 (a) to 25. The example will be given 
for the situation shown in Fig. 23 (b), wherein four 
thumbnails 231 to 234 are arranged in the line layout. 5 
The thumbnail 233 is the present focus thumbnail 25 as 
indicated in box a. - 

[0070] When the user input indicates to change the 
focusthumbnail to the next higher in the thumbnail line, 
that is, to the thumbnail 232, then the layout/order man- to 
ager 12 sets target positions D ) for the thumbnails 231 
to 234 based on the thumbnail 232 being centered in 
the screen as the focus thumbnail 25 as shown in box 
b of Fig. 23 (b) . By comparing boxes b in Figs. 23 (a) 
and 23 (b), it can be seen that the newly set target po- ts 
sitions D| of the thumbnails 231 to 234 are different from 
the present positions S v Therefore, the layout/order 
manager 12 gradually changes display of the thumr> 
nails 23 as can be seen by comparing boxes c in Figs. 
23 (a) and 23 (b), until the target positions match the .20 
actual 'positions S-j of the thumbnails 231 to 234 as . 
shown in boxes d of Figs. 23 (a) and 23 (b) . 
[0071] Next, a routine performed by the program man- 
ager 14 for changing the display of thumbnails in this 
manner will be described while referring to-the flowchart 25 
in Fig. 24. This routine is performed each time , the 
screen is updated. The screen is updated at.a fixed: irv> 
terval of 30 times per second. First in S50, the focus 
thumbnail 25 is changed by input from the user. It should 
be.' noted that if no input is. received from the user to 30 
change the focus thumbnail 25; then this routine, is end- 
ed here: Then in S5T, a thumbnail number i in a counter 
is seHo one: The thumbnail number i indicates a present 
thumbnail under consideration. 

[0072] In S52, the target position D, of the ith thumb- 35 
nail is set based on the new focus thumbnail selected . 
imS50. : lt should be noted that the target position Q is 
also set based on the present layout: For example; if the - 
present layout is the helix layout, then the target position 
D, will be a positioh;somewhere on the helix shape de- 40 
fined by the helix layout template. This is true for all the , 
layouts. : - - f — y.i : : - . .: .:; 

[0073] in S53, a new position S in ^, for the ith thumb- 
nail is calculated based on the it h thumbnail's present 
position S^es^nt and the target position D(. The new po- 45 
sition S^w is determined based on the following formu- 
la: : ; 

S rew = ^tpresert "*" i( D l " S qpresert V 5 ) 50 

[0074]. That is, as shown in Fig. 25, the distance be- 
tween the ith thumbnaifs present position S[p resenl and. 
the target position D, is divided into five segments. The 
new position S^^, is set to a position one fifth the dis- 55 
tance from the present position S^ resent . 
[0075] Then, in S54 the thumbnail number i is incre- 
mented by one to change focus of the routine to the next 



thumbnail in the thumbnail train. Once the routine has 
been performed for all the thumbnails in the thumbnail 
train (S55:YES). then this routine is ended. 
[0076] As a result of repeated runs of this routine, the 
thumbnails will eventually reach their target positions: 
Because of the process in S53, the thumbnails will move 
quickly at first, and then reduce speed as they approach 
their new target positions in a type of movement com: 
monly referred to as "easing in." This gives the effect 
that the thumbnails settle into their new target positions. 
[0077]* As rrientioned above, the focus outline 24 
moves slightly to greet the next thumbnail in the thumbs 
nail train during browsing operations. The templates in- 
clude information for displaying this motion. 
[0078] Figs. 26 and 27 show an example of how. 
thumbnails that represent, audio files are visually -.dis- 
played based on size and content of the audio files. As 
shown in Fig. 26y a music file 54 includes file information 
54a and music data 54b. The file information* 543 ^ 
eludes title of the song; the artist's name, and the playing 
time. To produce a thumbnail for the music file 54, first;, 
a portion, of the music data is retrieved. The amount of 
data retrieved; at this time depends on the size: of the: 
music file, that is, if the music file is large, then a great 
deal of data is retrieved. The retrieved data is, divided 
into sections: In the present example, it will be assumed 
that the retrieved data is divided into 300 sections. Each 
section has three 16*brt sets. In the .example of Fig. ...26*.. 
one representative' section has the three 1 6tbit sets of 
Of 7e 57 inhexadecimal notation.The 1 6-bit sets in each 
section are. used to. define one of 256 possible color gra-^ 
datidns for each of red, green, and blueicolprs.vln the 
example of Fig. 26,.the 16-bit sets of 0f v 7e, and 57 are- 
used to determined gradations of red, green, and blue 
respectively. 

[0079] The thumbnail for the audio file, is divided into; 
the same number of sections as the retrieved rnusic.da-, 
ta, that ;is; into 300. sections in this example- by^dividing. 
a thumbnail into 300 sections:(15 x 20), The color grar 
dations determinedly the three 1 6-bit sets of each; sec- 
tion are used to display color in the corresponding sec-, 
tion of the. thumbnail as shown in the secpndVsquar.e; 
from the top in Fig. 26. Once Ft(3B. values torall, sections^ 
of the display have been determined, then borders . be- 
tween display sections are blurred as shown in the third; 
square from the top in Fig; 26. Then various file inform 
mation is superimposed in capital letters over, the 
blurred image as shown. in the bottom square in Fig. 26. 
[0080] As shown in Fig. 27, the number of display sec : 
tions is increased or decreased depending on the size 
of the corresponding data file. That is, thumbnails for 
large. data files are. displayed with many sections, and 
thumbnails for small, data files are displayed with few 
sections. 

[0081 ] : Whi ^embodiments of the invention have been 
described in detail, it would be apparent to those skilled 
in the art that various changes and modifications may. 
be made therein. 
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[0082] For example, the embodiment described data 
objects being loaded from a memory card into a com- 
puter. However, the memory card can be replaced by 
any local storage device, such as flash memory, record- 
able media, hard disk, or CD-ROM Alternatively, data 
objects can be provided over a networked server, or. 
from any combination of local memories and networks. 
[0083] Further, data objects could be transferred via 
a network protocol by using a standalone apolication or 
browser applet. Such a configuration could be used as 
an on-line multimedia photo album, wherein a user up- 
loads data-objects to a server, and others browse the 
data-objects from remote terminals. Alternately, the us- 
er's computer itself could be used as a server. 
[0084] When the data objects are provided from a CD- 
ROM, then in this case alsothe data objects can be load- 
ed from the CD-ROM into the file manager automatically 
upon insertion of the CD-ROM into the computer. How- . 
ever, as shown in Fig. 28, ail executable applications; 
such as for performing the loading operation, f or display- 
ing the thumbnail according to the selected layout, arid 
changing display of the thumbnail and graphical icons 
when a different layout is selected, must be provided on 
the CD-ROM. 

[0085] This contrast to the case of a memory card.. As 
shown in Fig. 29, executables are provided in4he com- 
puter's hard disk or over a network... Use of a memory 
card is preferable because the executables can be used . 
with many different data files* not just those on the mem- 
ory card. Also, the executables can be upgraded inder 
pendently of the data-files. Further, although an appli- 
cation run from either a CD-ROM or a memory card; be^ 
comes the front-most application, other applications are ■ 
inaccessible in the case of CD-ROM, but are accessible 
in the case of memory card. 

[0086] Although the embodiment describes launching r 
an application in S41 for a single data object, an applk 
cation could be launched for more than one data object. 
For example, the user can bookmark several thumbnails 
using the- bookmark interface, and then launch the ap- 
plcation for all of the book marked thumbnails. 
[0087] . The layout interface 27 uses icons to represent 
layouts, arid the order i nterf ace.28 uses words to repre- 
sent orders: However, any indicia can be used to repre- 
sent lay outs and orders:- 

[0088] Although the embodiment described layouts 
and orders as being predetermined, the computer could 
be modified to enable a user to define new layouts and 
orders. New layouts can be defined using a visuarpro* 
gramming function that a user uses to position and size 
a series of thumbnails or other data object representa- 
tivesin a repeatable pattern. Such new layouts can be 
shared and distributed through a plucfin architecture. 
New orders can be defined by the user simply adding a 
new file attribute to the list of order parameters. Search 
criteria could also be stored and used as order param- 
eters. 

[0089] In the embodiment, thumbnails and the overall 



layout are displayed in the same manner regardless of. 
the selected order. However, the thumbnails and layout, 
could be displayed in a manner dependent on the se- 
lected order.. For example, when file size is chosen, as 
5 the order, then as shown in Fig. 30 each thumbnail can 
be displayed in a size relative to the overall range of 
sizes for the data objects. In two-dimensional layouts, 
such as the grid, line; and circle layout, the thumbnail 
need only be scaled in X and Y t: directions. However^ 
10 since scaling is used as a part of three dimensional lay-. . 
outs, that is, the helix layout, a thumbnail's relative size 
can be represented by adding isometric dimensionality 
or "thickness 0 to the thumbnail. ; 
[0090] When time is chosen as the order, the se- 
15 quence or pattern of how thumbnails are displayed can . 
be varied based on how close together! he data objects 
are in time. For example, the time between two data obr 
jects can be represented by varying the space between 
two thumbnail. In the example shown in Fig. 31, data,. 
20. objects represented by thumbnails 23m and 23n are 
separated by a. relatively short time^so the. thumbnails 
23m and 23n are displayed separated by a relatively 
short distance SD. Data. objects : rep resented by thumb- 
nails 23o and 23p are separated by a relatively long 
25 time, so the thumbnails 23o and 23p are displayed sep- 
arated by a relatively lo n g dista nee. LD . - 
[0091] . Alternately, thumbnails can be grouped togeth- 
er, and the groups separated from each other, as shown 
in Fig. 31 depending on how close in time the thumbnails 
30 are. For example, if a collection of .images were taken,- 
or a set of files were created, all within a certain time 
span, then the images or files from that time span .can 
be grouped together, and separated from other groups 
when there is a significant time gap between the images 
35 orfiles of other groups. In the example shown in :Fig.:32; 
digital photos that are taken less than 15.minutes apart 
are placed in the same group, and different groups are 
displayed encompassed - by lines > 55a to 55d. That is, 
. photos taken more than 15 minutes apart are put into a 
40 separate groups. Such groups could;alternately be indi- 
cated using different colors or text labels.. j - , • 
[0092] A more sophisticated algorithm can take, into, 
account overall image taking frequency, total elapsed 
time, and image criteria to adjust the groupings dynanv 
45 ically. Examples of how image taking frequency, total 
elapsed time, and image criteria can be used to. adjust 
grouping will be given for the situation of taking images 
with a digital camera. 

[0093] Image taking frequency can be measured by 
so determining the time intervals between all images taken, 
. finding the average interval, and comparing each time 
interval with the average interval. Whether images have 
a time interval greater or less than average can be used 
as a weighting factor for determining whether, or, not 
55 thumbnails should be displayed in different groups. - 
[0094] Total elapsed time refers to the entire duration 
of time from when the first image was taken to when the 
last image was taken. The standard time difference 
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used to determine what thumbnails are grouped togeth- 
er can be varied depending on the elapsed time. For 
example, if only an hour has elapsed since the first im- 
age was taken, then the standard time difference might 
be set to ten minutes. However, if 10 hours has elapsed, 
then the standard time difference might be set to one 
hour. 

[0095] Image criteria refers to using certain criteria, 
such as brightness level, color, and pattern recognition 
of images, to determine whether images should be 
grouped together or not. Each image is analyzed for cer- 
tain criteria, and thumbnails for images sharing the 
same characteristics are grouped together. 
[0096] Any dynamic element; such as icons, can be 
used instead* of thumbnails to represent the: data ob- 
tjects. However; thumbnails are preferable to icons, be- 
cause the thumbnail is the essence of the data object 
itself. For example, when the thumbnail is adepiction of 
an image, the thumbnail is the essence of the image it- 
self in a smaller size. Ah icon is a generic representation 
of a file-type, in which case all otthe same type of image 
would have- the same icon. . 

[0097]*: The : outline -24 need not be provided: for indi- 
cating the focus thumbnail 25, which is the focus of op- 
erations induced by input from the user. The focus 
thurribnail 25 can be designated merely by placement: 
in a focus region, without displaying the focus outline 24 
itself; ' . ■ 

[0098] In the embodiment, the application is launched 
when the memory card 2 is inserted into thevslot 2a. 
However^ the application can be launched when the 
memorycard2 is selected based on input from the user 
input unit 4. . ^ , ; > 

[0099] In the embodiment, the same application is 
launched when any memory card is selected or inserted. 
However different applications can rbe launched de- ; 
pending on the data in the memory;card or the type of 
memory card, ortolaunch an application only for, certain 
memory cards. ? - . * . 

[01 00] / Although the - embodiment described ;the sys- 
tem as being user controlled, the system could also.be 
autonomous. For example, a slide show mode can be 
provided for randomly presenting thumbnails, automat-r 
ically without user control. Thisiis similar to a slide show 
program that randomly displays images In a certain fold- 
er. The slide show mode can be initiated automatically 
in the manner of a screen saver mode after a period of 
in-action by the: user. The user can easily interrupt the 
screen saver mode by taking any action. It would also 
be possible for the user to directly initiate this slide show 
function; 

[0101] . Embodiments of the present invention relate to 
a device for managing image and audio files. that dis- 
. plays thumbnails, which are representative of the files, 
on a screen in different arrangements, depending on the 
selected layout and order. When the user enters input 
to indicate that he or she wishes tabrow*se through the 
thumbnails, the thumbnails move across the screen in 



sequence, following a path through a focus outline in the 
center of the screen. The path followed by the thumb- 
nails depends on the selected layout. 
[0102] In so far as the embodiments of the invention 

5 described above are implemented, aUeast in part, using 
software-controlled data processing apparatus; it will be . 
appreciated that a computer program providing such 
software control and a storage medium by which such 
a computer program is stored are envisaged as aspects 

10 of the present invention. .* 

[0103] Although particular embodiments have been 
described herein; it will be appreciated that the invention 
is not limited thereto and that many modifications and 
additions thereto may be made within.the scope of. the 

*5 invention. For example, various combinations of the fea- 
tures of the following dependent claims can be made 
with the features of the independent claims without de- 
parting from the scope of the present invention. 

20 . - --*..'•- 

Claims 

1. A device for managing data objects,^ comprising: 

25 displaying means for displaying, thumbnails 

representative of data objects; 
defining: means for def ining a. focus region that 
indicates a focus thumbnail subject to process- 
es; ■ ,,; v - - '* 

30 moving means for moving the displayed thumb- 

nails along \ a predetermined path through the 
focus region; and 

enable/disable means' for selectively enabling 
and disabling the moving means; the displaying 

35 means statically displaying ^ single thumbnail 

. in the focus region when the enable/disable 
means disables the moving means; the display- 
ing means displaying the thumbnails to move 
along the predetermined path throughihe focus 

40 . region:when the enable/disable means enables 

-the moving means. ^ . ' - 

2. A device as claimed in claim 1 , wherein the display- 
ing means displays the thumbnails in partial overlap 

45 with sections of each thumbnail exposed; and. 
changes relative position of thumbnails to change 
exposed sections 6i. thumbnails, while the enable/ 
. disable means enables the moving means. 

so 3., A device as claimed in claim 1 , wherein the display- 
ing means displays the thumbnails in partial over- 
lap, and changes overlapping sections of thumb- 
nails while the enable/disable means disables the 
■ moving means. .- ■ , 

55 ... . , -", , . . . : . 

4. A device as claimed in claim 1 , wherein the display- 
ing means further displays an interface portion with 
a plurality of indicia, and further comprising selec- 
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tion means for selecting one of the indicia of the in- 
terface portion. 

5. A device as claimed in claim 4, wherein the indicia 
include.a plurality of layout indicia each represent- 
ing one of a plurality of layouts, the displaying 
means displaying the thumbnails in relative posi-. 
tions, and the moving means moving the thumbnails 
along a predetermined path,. in accordance with the 
layout indicium selected by the selection means. 

6. A device as claimed in claim 5, wherein the display- 
ing means further displays file names of files con- 
taining the data objects of the thumbnails, the dis- 
playing means displaying the file names ina pattern 
that is inverse a pattern formed by the thumbnails. 

7. A device as claimed in claim 5; wherein: 

the displaying means displays the selected lay- 
out indicium at a present layout position to inr 
dicate presently displayed layout of the thumb- 
, nails; and . : 
when the selection means newly selects a lay- 
out indicium, the displaying means -displays 
movement of the newly selected/ layout indici- 
* urn to the 'present layout position and move- 
ment of a preceding selected layout: indicium 
out of the present layout position. 

8. ?*A device as claimed in claim 5, wherein: 

vthe layout indicia include a line indicium; and 
when the selection means selects the line ind- 
icium, :t he displaying means displays the 
thumbnails in a line layout with the thumbnails 
aligned in, partial overlap in a line. . 

9. A device as claimed in claim 8, wherein the display- 
ling means displays the thumbnails in the line layout 
with a reciprocal pivoting motion , the focus thumb- 
nail serving as an unmoving axis of the pivoting 

-movement. ' ' 

10; A device asclaimed in claim 5, wherein: 

the layout indicia include a circle indicium; and 
when the selection means selects the circle in- 
dicium, the displaying means displays the 
thumbnails in a circle layout with the thumbnails 
disposed in partial overlap in a circular ring. 

11. A device as claimed in claim 10, wherein, when 
number of thumbnails exceeds a predetermined 
number, the displaying means displays a portion of 
the thumbnails in an arc with a predetermined radi- 
us and the moving means sequentiafly changes dis- 
played thumbnails while enabled. 



12. A device as claimed in claim 5, wherein: 

the layout indicia include a grid indicium; and 
when the selection means selects the grid ind- 
5 icium, the displaying means displays the 

thumbnails^ in a grid layout with thumbnails 
aligned with fixed mutual positions in rows and 
columns. t v 

10 13. A device as claimed in claim 12,. wherein: 

the. displaying means displays the thumbnails : : 
in the grid layout in rows haying a length that 
can be completely, displayed at once; and >*.. : 
15 . when the enable/disable means enables the 

moving meanSj the moving means moves the 
thumbnails of a single column through the focus 
■ .-. region. • =v r- - : 



20 14. A device as claimed in claim 12, wherein the moving 
■means when enabled moves the thumbnails in the * 
grid layout through the focus region one row at ,a v 
time, ini succession, starting from the same end -lot ? ; 
each; successive row;; . ! = 
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1 5;-' A device as claimed in claim 5, wherein: 

the layout indicia include a helix indicium; and? 

when the selection means.selects the helbfcin<>. 
: dicium, the displaying ;meansV displays, the - 

thumbnails in a helix layout that mimics^aside 
. view of a helix by displaying thumbnails;atarfar 

side of the helix in a smaller scale than thumbr.- 

::nails at a near side of the helixv ; " • A 

16. A device as claimed in claim 15, wherein the dis^ 
.•• playing means displays the thumbnails in the helixV 
layout to mimic ahetix with: a shorter, radius when- 
the enable/disable means enables the" moving v 
means, than when the enable/disable means disa-v 
: bles the moving means.- 



17. A.device as claimed in claim 1 5;>wherein the. dis- 
playing means displays movement of t the thurrib- 

45 ' nails in the helix layout through the focus regioncby,: 
1 displaying spiral movement of the helix.. ^ 

18. A device as claimed in claim 15, wherein: the dis- 
playing means displays movement of the thumb- 

56 . nails in: the helix layout through the focus region by 
shifting the helix one pitch distance to move the 
present focus thumbnail out of the focus region and. 
to move a thumbnail of an adjacent ring of the helix 
:into the focus region. 



55 



19. A device as claimed in claim 5, wherein, when the 
selection means selects a new layout indicium-that 
is different from a preceding selected layout indici- 
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um, the displaying means repositions the thumb- 
nails into a new layout that corresponds to the new 
layout indicium while displaying the thumbnails 
moving toward and into positions of the new layout. 

20. A device as claimed in claim 4, wherein the indicia 
include a plurality of order indicia each representing 
one of a plurality of predetermined sequence or- 
ders, the displaying means displaying the thumb- 
nails in an order represented by an order indicium 
selected by the selection means. 

21. A device as claimed in claim 20, wherein: 



10 



further request means for indicating desire for fur- " 
ther information on data object that corresponds to 
the focus thumbnail, the displaying means enlarg- 
ing display of the focus thumbnail when the further 
request means indicates a desire for further infor- 
.rrtation. 

27. A device as claimed in claim 26, wherein the dis r 
playing means displays application indicia .repre- 
senting software applications when the further in- 
formation request means indicates a desire for fur- 
ther information on the data object of the focus 
-thumbnail. 



the displaying means displays the selected or- 
der indicium at a present order position to indi- 
cate present order of the thumbnails; and 
when the selection means newly selects an or- 
der indicium, the displaying means displays 
movement of the newly selected order indicium 
to the present order position and movement of 
a preceding selected order indicium out of the 
present order position. 

22. A device as claimed in claim 20 t wherein, when the 
selection means selects a new order indicium that 
is different from a preceding selected order indici- 
um, the displaying means repositions the thumb- 
nails according a new order that corresponds to the 
new order indicium, while displaying movement of 
the thumbnails into positions appropriate for the 
new order. 

23. A device as claimed in claim 20, wherein: 

the order indicia include a time indicium; and 
when the selection. means selects the time in- 
dicium, the displaying means displays the 
thumbnails in groups according to when the 
corresponding data objects were produced. 

24. A device as claimed in claim 20, wherein: 

the order indicia include a time indicium; and 
when the selection means selects the time in- 
dicium, the displaying means displays the 
thumbnails separated by distance correspond- 
ing to time between when the corresponding 
data objects were produced. 

25. A device as claimed in claim 4, wherein the indicia 
include a plurality, of application indicia each repre- 
senting one of a plurality of applications, and further 
comprising an application launcher that launches 
an application that corresponds to the application 
indicium selected by the selection means. 

26. A device as claimed in claim 1 further comprising 



is- 28. A device as claimed in claim 1, wherein the display- 
ing means displays thumbnails of audio data ob- 
~ jects for audio contents based on data of the. audio 
data object. 

20 29; A device as claimed in claim 2B\ wherein the dis- 
playing means displays thumbnails of audio data 
objects according to amount of data in the audio da- 
ta object. . - ■ ... ■ 

25 30: 1 A device as claimed in claim 28, wherein the dis- . 
playing means; displays thumbnails of audio data 
objects according to content of data in the audio da- 
ta object. 

30 31 i A device as claimed in claim 1 , further comprising: 



retrieval means for retrieving data objects from 
a; memory; card; and ; t - . 
recognition means for recognizing presence of 
a memory card and activating the retrieval 
means when, a memory card is present: 



35 
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32. A device as claimed in claim 31, * wherein the dis^ 
playing means displays thumbnailS:one at a time in 
. . a sequence that the retrievahmeans retrieves the 
data objects from-the memory card. 



33. A device as claimed in claim 1 , further comprising 
search means for searching to find thumbnails that 

45 meet certain criteria, the displaying means display: 
ing only thumbnails found by the search means. 

34. A device as claimed in claim 1 , wherein when the 
enable/disable means enables the moving means, 

so the moving means determines a target position for 
each thumbnail, and moves the thumbnails to their 
respective target positions in an easing-in move- 
ment. 

55 35. a device as claimed in claim 1 , wherein the display- 
ing means displays the thumbnails in a line layout 
with the thumbnails aligned in partial overlap in a 
line. 



13 



25 



EP 1 148 412 A2 



36. A device as claimed in claim 1 , wherein the display- 
ing means displays the thumbnails in a circle layout 
with the thumbnails disposed in partial overlap in a 
circular ring; 

37. A device as claimed in claim 1 , wherein the display- 
ing means displays the thumbnails in a grid layout 
with thumbnails aligned with fixed mutual positions \ 
in rows and columns. 

38. A device as claimed in claim 1, wherein the display- 
ing means displays the thumbnails in a helix layout 
that mimics a side view of a helix by displaying 
thumbnails at a far side of the helix in a smaller scale 
than thumbnails at a nearside of the helix. - ■ . *5 

39. A method for managing data objects, comprising 
the steps of : . 

displaying thumbnails representative of . data : 20 
objects; > v 
defining a focus region that indicates a focus 
thumbnail subject to processes; and . .-. 
selectively displaying a single thumbnail in the 
focus region, and displaying the thumbnails; -25 
moving along a predetermined path through the 
focus region. ...... 

40. A program storage medium for storing data of a pro- 
gram indicative of a process for managing data ob- 30 
jects, the program comprising: 

a program for displaying thumbnails represent- 
ative of data objects; ■-. ■■ ; 
a program for defining a focus region that indi- 
cates a focus thumbnail subject to processes; 
and 

a program for selectively displaying a single 
thumbnail in the focus region; and displaying 
the thumbnails moving along a predetermined 
path through the focus region. 
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